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Abstract of JP8263639 
PROBLEM TO BE SOLVED: To reduce the 
influence of aliasing, fogs and noise, etc., in the 
reproduction of pictures and to provide high 
resolution pictures. SOLUTION: In this device for 
generating the high resolution pictures from a 
series of low resolution motion pictures, the 
mapping conversion of the respective low 
resolution pictures 10 is generated 12. By the 
mapping conversion, the picture elements of the 
respective low resolution pictures are mapped to 
the positions of the high resolution pictures. By 
using the mapping conversion, for the respective 
picture elements of the respective low resolution 
pictures, a synthesized point spreading function 
(PSF) is calculated 14. By using the calculated 
synthesized PSF, by projection to a projection set 
(POCS), the high resolution pictures are 
generated from the low resolution pictures 16. 
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i m&m i ] —m co (s w«k - •> 3 > e mm 

tr. 

<fe&B&WB§l?£iili^3r;BfSicofirgir^ r-f-^ 

b. fMe^y e^^&^H^ &&M&mmi&<D& 

mm^M-fZ, &i&£tifz£Mtf'9m& (PSF) frg 

c. ftfHE^»r»tPSF$rfflt>-c, ia*-&^«5#tjg cp 

tr. 

a. mmigmi&(D l o£g2fiB{|!£: tTilJR-f--5^^ 

c. aipM««^ro4He#p*a[iifffe«>Hjii^*rbT, * 

d . {g;^fc£B{fcri>£>it5JS?&&B&^<DW^&-^ y 

fiKPSFSrgtiitS^fs'T'ii, KT^Tyyj;^ 
tr. 

b. mmm$h-y->-7°!) ^^t^—^-\<dv s FSrw-art- 

c. ft^P SF^t5^fs'7 , i:> 

d. #E^com-^$^fcPSFSr3t^PSFt^ 
U =&i®*(c:o^Tco^$^/cP S F^^/jjc-r-S^T 1 

[fS*«K4] l«*igl KfE^OT^IfeKfcv^C. POS 

a. mmmmiMLtDi-oz^ mm&8.w\fo<n&%i<nmm 

^*Uc *J It 5 # B* 1= *f L . ffilB S5J$?£l«BfS> colS^ffl 

£«T«;frfet;-J:!9&&-r-5*x y^, (l) 

Bf£<0 l o[d*D»t5 1 fi*&iiitR L. (2 ) SfliEil*R$ 



(2) »¥8-2 6 3 6 3 9 

2 

miz&tfm (back project) 

to i s ] -m<oi&Mte& * - e> m/^ 

(source) , 

b. mm-mvi&M&mmiSiZ&mL, mmi&&w&* 

Srfi5^SH«S!^ag(r^s/7'-#-5^, (2) ilfJiE-v 

x&f&ztiti&mi'oMm (psf) sr^ta-rs^s. 

(3) ffifE(3f*tP S FSrfflV^-C. fl*-g—-co*tI£ (PO 
CS) K<fc»3, ffiMttXBIfe^&iCMIMIfVtfetr^ift-t- 

30 [00 0 1 ] 

at-Mi-^o .t^^iClfi, (blur) -^/-YXcoPn^ 

HSr*L, ffiScO^g-?- (arbitrary lattice ) JnKT^ 
^— ihVT'y V^$^fc (under-sampled ) — ig<£>*— 
->3>-B^ (motion image) /5>£.ii5fl?{£,K^^^B{& 

(still image) Sr»5ftWKB8i"«. 

[0 0 0 2] 

*- ->3 vsf«i±. fffiBw^attu-rwif^i-s*?-^^ 

[0 0 0 3] ±|EWJ; ? &{B#{fc£ffffctt. ii«f, «ft 
■*-S3SIB»^- (-T^fc*.. tv/y v^t&^f-) _h(;r> 

50 hOl^±t*7- ; v^-t"5*7 — 
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3 

•rti^%x.bnSo i"ft;b*>, -fe^Stf* (sensor i 
ntegration ) , iy—>t^^^(D^MMW). /V-tfn 
T'<—^W$m. AOtft^Hfttfeu^Xr**. - 

[00 04] 

/^■«i^*rt*SLtfLtfH*ft*. ^S*bfeX9vMB 

mil frSMt bfe t co -eft ttti «* b * v \ 

[0 0 0 5]*1#^5, 3 4 1, 1 7 4f t^- 
$ *xfe t^*fc*^»BjMRjes tt, f^t-W -Y Xfc £ 

53fcffc«r^*bri*jsv\, b feasor, ffit^/YXi: 
■fcorslMbbfcf*— -t^ttld-cfflv^fejx-cb* 

[0006] *^»^asitsaf^tej:oT4csfj»tfc 

(t^ft*nTV^S 0 -fft;b*>. rjifft3SP3<^fe^<7?^~ 
Z/B^ftffi:ffi^ fflm (occlusion), RZfi&W8t_ 

(M. Irani S.Peleg. J. of Visual Comm. and Image Re 
presentation, vol. 4, pp. 324-335, 1 9 9 3^1 2 
M): rffi^^n— X: t'f t jii^ b ^)iSn p pf ^ f ;UHt ^5 
Sfifcj (IEEE Int. Conf. Image Proc. , (Austin, TX), 

1 9 94¥llfl) ; mV6L&miZtlZ>MtilLm<Ofa 
±J (M. Irani S.Peleg, Grafical Models and Image P 
recessing, vol. 53, pp. 231-239,1 9 9 1^5.3) lr 
E*fc<a2f8s-CS>a 0 btf>bfttfSb, ±ia^^rffitt % T^n° 
^^NFMSr%«fcAKT*5fei*, il*Jl3ftt (motion b 
lur ) &ag«Hwtttort*fcV\, SfeK, i:IB<z>*j£tt. 
/^X^i^^kSr^-x'/u-fr-r, ^ft&%l8:br^ft 

W»^J* % bTSf&#lt&OV-f X(r J: 5#>ffco 



(3) W8- 2 6 3 6 3 9 

^ 9 — * $ nfe frt^ 6 ?#fe fc cor* -5 ifr&fc: 

14, *£*brfti\ /D^u r >y/j:AA 

[0 0 0 7] A. M. r^/U/ttd.tS ^ffi$¥{£SiBf& 

is—^^*frh<Dmu\%L&.m\sm%., st/awwfc (sp 

70 ace-varying ) BHftHjcJ (IEEE Int. Conf. Acouus 
t. , Speech, and Signal Proc, (San Francisco, CA), 
vol. Ill PP. 169-172, 1 9 9 2¥3fl) te*3V*rRW 

(pocs) {i^<^ffl^bnt^^o ^(Djjm 
y± s •fe^ar^i-isiarit, xo c >'>fXfc#Lr%jtb 

t^5o b^bft^b, rco*ffittill!iff*t^*ht-5* 

it^ft<, £bt-, 4>9~- is— ^axri^ftv^o^ 
i^^^yftA^Wfti-^^igffl^pg^^ttr^So 

[0 0 0 8] 

20 [!SjHSr«?*-r^fe^co^S] ^©IftoioB, 
■^i-^rfc»»i-5*j56fcl«fti-6^i:r*6o 

s^^v^irv^coffi^jii&^*s#^(JDr 

(«j«<^ffi»tfeu^XteJ:5) , Ktfy-fX (±>^R 
[0 0 0 9] **Wa>»J*>BWtt, y y^oH 

tsr fc^r#s 0 
[0 0 1 0] *«W<0X*fiBftl*, ffift^^y >- 

^m^ii^f-v^y ^^snfeis»»«iis«^fei«»« 
S**»a'rtr^>f yT^^^«wsrifi«u 

[ooii] **Mco3E**B»tt, fy/y 
SrilftSrtTx/f y r^v^eo|g#S:iB:«b, 

r, ttE^i^v^y ^te^-jnicij-^y v^snfeis 

*»6 KWttftBfft * fttt-t h r i: \z * -5 0 
[0 0 12] *&W(D%il<DBm*. K«Efft*-=e— K«r« 

t<or#4*8feS:ift«i-Sit»r*S 0 WISB5#flft«* 

50 5 0 -Tft^^, *B»»»"*-SiSttBftt^ftiS»-*Oii* 
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^ttyhiS^fftftMftfi, #9— (cf 
A) frB^ttKcfcOiaffiS^WW^^y^^S 

*y\z. mZ-Yt. 0ffi> S^JCwftftrjlittff 
^sjfiv ^^vHlH^co^ff^M^HS J: 9&-7^^ h ;yX 

[0013] ±BBWtt, *«WKJ:9, — ai^ffiJIMl 

Afc«t»t5ltlJ:«tota*Sh5 0 flUISi/^xA 20 

•^^^-r^o ^<^;yfc 0 vX^&ffl^T. (comb 
ined ) j£t£# 9 B8« (PSF) #{£#g«ffiIB{ft<D 

T\ G*^— <Z)St^ (POCS) (projection onto co 
nvex sets ) ti5 % ffifflftAHIft^&ffSMtttftHttAS 

[0 0 l 4] *3BWf4, «T^J:5*«i*Sr#-r5o A 
JH-K (pocs) fc»-3<*tt«r/B^-c\ /-r 

x % HM(D^±^^yv ^yzntzmm^mm&m 

36Wtt\ 5SRj*t;i£ (motion estimates) ^lc&5r 
[0 0 15] 

[«W^^Jteo^H8] Hi 



#I¥8- 2 6 3 6 3 9 

6 

[0 0 16]*^lt 3ocO±^«ll^f^&# 

»*««*aFix* 0 5>«Hf*»Bt (fractional p 

ixel accuracy) &*i~SS&co|5gJf §!!Xp yt^y^is 

^HWfFKS, 241, 608-^(199 3^ 
8J3 3 1 JSW# : ^^--y/U) tBJjR^ixTt^ 

MWi^r^f^ (locally translational motion model) f£ 

A/Hf (shear ) St^tvu-TS fc^-e$>5 0 

[0017] ^2£>*Q.a;*xs/Xl 4Ti3\ ^(DX'ry 
^1 2(r^^T^$nfc-^3/t: 0 ^^ v amit$6i:. 7V< 
—^■rWIBJ, -tr^«W (geometry) , #¥3Rlf 
**9Hft (psf) , At/iHHftatt^yy^iii 

(HR) SrfflV^T, -&dtff*tPSFj9Sjmj*n* 0 -tl 

f&T^&^-zvi; (image formation model ) \z^^^ 

[0 0 18] |3^fy/l 6tC*5^T, B5MtSHJ 
ffe^jEjg^tiSo rcO^x^^Tfi, ^liltPSF, 

*I»10^ POCSi:S<5<M-Cfflv^ft5o - 
gi^^rco^j (m. i . -feu* rjegg«j£j ^ 

1 9 9 2^ff|4 0^ 5 5-6 7^-^) CO!ife5:(- 

ffi±\z&&<DV i^rf^^ IS tt-W -Y X(c J: >s 

[0019] ffi^ifednrtta. »ft5NFjSt«45t> 

fft*«Bl2fc**ix5 0 (a) (4X^r^e.v„KM 

— > ( c ) tt>f 

^ItV^o (b) (d) (4, fSMftS 
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£ 0 iS*Ptt«Bfflfc<^ 1 o-Cttft < , -r-<T^iiig 

[0020] H3Cli, *5SWwSafcfcftfico»«^7S 
3-y/VCR2 0, f^v f ^^f;U^7^7 2 4, 7* 

Z>o MMrrj v^yu^e— ->g ^SHfeU tMji^^S ^ >- b:° 

■ 3 211 ^!7 — P C/^ifO^Vt: 0 ^ — * 3 4 , — t&Sb 20 
J-S VGA^fctt^lxJKi^lWfcaffeW-t-SCRT^-f 

*^^^4^^E«BE#:4 2, £fcfltl^^ ;*'7 p u 
^ J-ies#¥f&tfiIH*£;£E^ b ? — ? 4 4 fcgs 

[0 0 2 1 ] *»OiS#f««Bf«^s=i ytv-^gi3 
JS^iSW^fe^Hlfe 4 6 , 4 8, SOS-ztLT^^o 

So B4 0ftm AO«s«ll««5 2«r»/*LTl* 
ixfe*f*««5 2^»jCi-^««S:ait»tcs^i-5r: 



ffl¥8- 2 6 3 6 3 9 

[0 0 2 2] A. -yy^^ft 
<B#fcfWtt^*ft*fta>&^ 

3£$H, Mf@(7)fa^?ftft(Wft(C^L-C, (M 

-l) IB<DiiIb^ h/u#*5f#&ft, :WiJ:!)v>yfc 4 
fft4 6^&X2p|5tt4 8 &M65ft&— 

l^feftTl^So 

[0 0 2 3]fi«P*«Ift4 6, 4 8, 5 0, 5 3(1 
4, St;im:^t8fiSfM^Wf5 6«H6 

6tiSo hywi fa^itnff^co^n-Fn^* 
R^w*^*tuTit^*n, (M-i) 

[0 0 2 4] yn^^^^/fy^ffi^i^ ^cDSK, 
il /Sj^rWaUb (local ly translational ) -?&>5£:{H 

3fifS (approximate ion) tfS:*^&Sftj<kfc5 0 M. fcfr 

(Proc. SPIE Visual Communications and ImagePro 
cessing'88, pp. 942-951, 1988) fcfB<ftG>WJifi&:/o 
*,?^>y^^sfjjfe (HBM) ar/Hl>T\ ^Fi^7— (T^iSS* 

4&rt s i£^$ft£o --^v^ftT^S^^^^vjg 
H »^Dy^W<03p^j|ft»M (MAD) -?fc3 0 |5g 

[0 0 2 5] 5 u^^<DHBMSr|ll£-rS60tc:ffll^sr 

r. r^e, — &&<Dm\z7jk&ixx\<^z><Di)^m ^-<^wlx 

[0 0 2 6] 
[*1 1 
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(6) 4$ffi¥8-2 6 3 6 3 9 

9 10 
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T% ^tfc (variance) f£1^— MM Xco 2#<^> 1 

-5 Wft S»Srt- 4 Bf *M rSl& xm mjy fa <0 

aitfei. *^>^y^^«* (ssf) 



(0te> ii-/y»f (v'T— ) , so^A(aotfi: 

20 (inter- image motion) t^rV^S Lv \ 

[00 2 7] 



rft?)0/>7^-^C1 , C2 , C6 ^ffi^-T^ 

P. K R. fc^=f9— S. ^^^±5, 

(IEEE Trans. Pattern Anal. Intel., vol. 14, pp. 8 
86-896, 1 9 9 2^9J33§fr) fcKW ;i<£>jij£ J0 
*tt-Ctt, 25WWXV«PBBW**B8« (derivatives ) 

Lfc5 x 5^"?^ V K^tdjg^-t-^ (fit) 2-D2ft 

*H*Kfe^S2jS*PR«rJl»>(2-poirit finite forw 
ard difference) £:/B^T3SfcH£*i5 0 rtb?>60^M^ 
^jfJ^Ste^S:*^ llxl 1 coHi*^— tfJt (pixe 
luniform blur) Srfflv^TK&Srf£lt£-t±\ /-fXcofJ 

[0 0 2 8) — r^— v^^^is, flKW^fy 40 

tf, i» % #> *s-tn-P4x*Ba*na. utja*o-c\ 

GB^^»SSt;2o(Z)feM («ifi, Y.UV) —cog: 
[0 0 2 9] B. ^/&P S FcD^ex.y >^Rimg 



[0 0 3 0] S-T, AA*nfciB«MfcaEH»S:, 

swwtr fcjav^-c, mwmm^v^m ils 

ft (discretization) Kol^T<Pia?8;^£;h,5o 
[0031] ^jfj^eg^ 

t^5 0 Hfc*5VvT, A^f.-^-f (xi , x 2 , t) 
5o ffi*¥f&KBHfe f (xi , x 2 , t) He, irv-^co^ 

««t«ha (XI , X2 , t) fc**Wlf»t«ho 

(xi , xa , t) OT^^filcJiis, rixfc-ttfc-fc 
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(7) 



6 3 6 3 9 



// 

[0 0 3 2] 7/<-ftl*H«)|ffB, W-K^y 
Stf^lg (time-domain integrator) trJ:oT, El 7 co^ 

[0 0 3 3] 
[t2] 

*2 (*1 • *2 • O « f !-r fl Si <*1 ^2, t )rft t 12) 



12 



(LSI) -C*>9, % 20)&6 2*S«FMtt*LS I 

[0 0 3 4] H7CQ»3^a6 4-Cf4, f£;ftco£f^-0# 

5 0 -^©<OttJ.^tt, g2 (mi , m 2 , k) iiiot 
5*Sft-0*S 0 B8«3I#* (function argum 

ent ) il'CSWItttmi, m 2 , k tt«fe^^*3 

/0 [0 0 3 5] 
[ft3] 



(3) 



^^6 6^*3V^t," <B*P4ft*-fev^J:4#Jpfi9«:y 
[0 0 3 6] jlft^tf^rA; 

[0037] isffij-^ ^ ^mimfo^ M^m& £ n s 

eh, 0 7(O*»2o«6 0&t>*6 2Sri8a^^ 
[0 0 3 8] 30 

nesc4] 

rCx, O - fiMdx. t. t r \ t r ) = r<Jfr r .V X ( 4 ) 

±5£fc:*3^-C xtt (xi 



* (x, t, tr ) 14, ffi«xAtW»IB tK*3Jt5ai<fl!> 

^^IStfcSo ilSb$fcil (motion traject 

ories ) fc»o/t»^«r*:Hto^Jt3e*ife-e*bfct, 
C0-e&5o hi (x, h) =h a (x, t) **h 

o (x, t) drt^^^Hiot, ^fyy^iig 

[0 0 3 9] 
[fgC5] 

ft(x.r)«J%Cx-x)/(*'MC (5) 
[«6] 

SrWt**, * (4) S:«^5^ilr±t), * (5) J4 

[00 40] 
[«7] 



X2 ) S:/Tltl^ 0 M ^« 

ft<^0-/^(*-Ar- , ( JC/r .r,/J)/(x fir ,r r )ly(A/)r l rfr /r 



(6) 



::t\ M" 1 f4S3E*S:*U J (M) \ZM(D-Y=i trr 
^Sr^U |. I HtfTjiJSlfe/flSH (operator) 5rtU 
V^£ 0 it (6) ^f/WllgfiLSVt^U- 

-t-5tf:tf>^ (7) ^ ±>vmffi<Dm&, ytms 



(7) 



40 



Oif (PSF) «r*-fJ;5lcbfco 
[0 0 4 1] 



5o - -Xf4, ir>-^^c9T/°~ ^-y 6 81 
^{t^fe^T (imposed ) v^ 0 ^{flijcoif&f^ B#KJ t r 
!-*5WSlRlDliMft*a3ffiSr^Lrv^ 0 WPWJt^btr 4 

(6) Sr, LSVJgS-Ct^Itt, 
[R9] 

ft C*. /) = J Aj tx; .r, r ; z f r r )f(x tr , r r )<ir, r < 8 > 



(Oct 5 I-* Six So 
[0042] 

[0 0 4 3] 
[«1 0] 



(8) 



*frftl¥8 - 2 6 3 6 3 9 
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Siixj) = j f f - Ta jh } (x:. T/r : t.r P )/(jr, r .t r )dx tf rft 
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(9) 



m / A<DMF¥&&?LZ>Z.tlz£>9 ^ ±ftl*EkT<OJ:5\zt£ * [0 0 4 4] 

* [til] 



(10) 



(11) 



10 0 4 5] r<^>J;5(:, ^-7* U v^co*^]<d 2oco|S 



[0 0 4 6] 
[»1 2] 



(12) 



±afc*v^r, h 2 (* ) »#»LSVtfltPSF-efc *2 , tr ) S:Pitl:ftb3ttO^Hil<3»t*i t*as L 
9, »»3I#JS (integer auguments ) rm , m2 , k \\ ^ZX\ i«)l!co(i«»«fa-&to-a«« (discrete 

test (3) ^^J^TtlRl— ^fi?IR**-t"^ 0 20 superpositionsummation) * x &sT<DtX:<D£ ?\zm~t 

[0 04 7] BUfrfb (discretization) - t lz-f& 0 

* (12) ICli3lt6LSVffltBB«SrimRlbL, [0 0 4 8] 

tt^(SMfluCVfft«:. 2ll»oi«#te#M* f (xi , x* [*13] 



Oil Ji2 ) 

X2 , tr ) te N 2 



^~C\ ififfi-Y^-^f (xi 
[»1 4] 



(ni ,112, tr ) &Mf&i-Z> ( (ni , n2 ) « 
[*1 5] 

mi 6] 

Srfi^ Zbfc X ot, f (ni , 112 , 

[0 0 4 9] (*-<^i«#pflfc«H*S:3g*$-fr5 (givi 
ng rise to) l@^coift«?tt*ir^^T-fi, te^F- 
[*1 7] 



[*1 8] 

[00 5 0] 
[ftl9] 

C , r (ni.n 2 ) 



(Otg.& s ni , n2 h L 

7t^-^- y h-t/u (3) LTflJV>fcjh/Clf> 
-5c n<*>cfc 5*3£ttfc:J: 9, £<bKf (xi , x 2j t 
r ) 14 
40 [»20] 

±-C»Sff— j£^fc5£:v*3(K£K:£<5# % a (12) tt 

[0 0 5 1 ] 
* [#2 1] 
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(9) 
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15 



[ 0 0 5 2 J 



16 



[«2 2] 



(15): 



»^l^^rni , 1112 , k, ni , 112 tt* 
(3) ^*j^ti:EI«*rjSPRSn6 0 
[0 0 5 3] H9«rtt, *»LSV PSF^S^l 

[*2 3] 

^C»t*5:^ ,<& (mi , ni2 ) 7 3&tp>t?t 
*ftTi^5 0 (XI , X2 ) fflMtt, l*Htr ^*3*t5 
[f24] 

fc* fS^Sir^T^-^ 6 8CJ:oT r — $ 
tifzM£M<DmmK WW 7 lfcioT**ti-CV^6 0 
* (15) ir*5V^#g$tl«»LSV PSFfj:, 



[»2 5] 

6 9±ic r##Ufcj (dwelled ) {£A?f£*ir ^ 6 8 
**5. S (15) ^snTV^5jB»H:, ir^T^— * 



[«2 6] 

^ir <rl l ' "2 ' 

6 9 0|iq<aJ|itt£ftfNttfctt£LT&v\, 
/0 [0054]MPSF«|ffi 

S (15) KJ:oT#i&e>;h,5»3:»*IH» 

[f27] 

A/ r f - J 

*«6«*»bix5o rwim^ffif*, mi<n&Mimm<D 

[0 0 5 5] 1) #gj5£ilgjj 



* (piece wise constant velocity motion paths) 3:, 

[00 5 6] 
[f28] 



(16) 



^^<t#> Jgffivi , k MV2 , k (Vk = [VI , 

k v 2 , k ] t ) tt, 7/<-ft^fflTa irfofcO — * 
t?*5:t, (tk -Ta ) lir^— ^-^okSB^Hi 

[»2 9] 



^*5B#M«f«$n, PSF 
[»3 1 ] 



ii'LS I 9 , 
[«3 2] 

[00 5 7] 
[3&30] 



fiifemZtl. 5t (7) W (11) ^igffl^iXSt, & 
[00 5 8] 

OTStt, ffltk SO't, e9ffl»-<?fc3 0 7t^«)(^(t7)5^ [f33] 

*'2U'.'f) = ^-J o %,(j+.rt Ji +v t t)rfi (17| 



[#3 4] 
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(10) 
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17 



f 1 AWi &Afi f 



18 
<18) 



iaoT4x.Wc2-D (rect) j BS#T*>4 

[Sfe3 5] 



[00 5 9] lJlth'2 S:S6l:RMt5fcft|:, 
[*3 6] 

[Sfc3 7] * 



51^ (xi , x2 ) ffirt-effi*(^««irE^"f-5r t 

[«3 8] 

^>ffittxi *>±ofx2 fc*5#t-5— ac*es;fcJ:o-c** 

[0 0 6 0] 

[«5C3 9] 



AM 



2 + ^r.))-^-(^-^r.)J 



(19) 



(^isEa^co-r^Tro (xi , x 2 ) f^LT) 

-rot*. k«, filifep sf 

[#4 0 ] 

SrjEi&fb-f- 5 :tl;J;t) KMi-a C <t cot-* § *-{r- y 

[0 0 6 1 ] s: (15) copiifrp SF 
[*4 1 ] 

K 

14, 011 
[»42] 



6 gco^'^S 2 (4, 
I«4 3J 



[«4 5] 

x J (r77 | .jn 2 .-fc) 

[»46] 

tt, ««6 9t*3V^T, (mi , m 2 ) &T>* 

(ni , n2 ) il<totftt$ilt^§ 
[$C4 7] 



[*SC4 4] 



[00 6 2] g^t, BiSfciafaSrffll^T. 
*fft5:tl:±9, **W^+h 0 (x, t) 

[0 0 6 3] 
* [«4 8] 



[*4 9] 



("J - "2 > 



COT^t), ** n 



n2ii^^ (m , n2 ) ±<D2- 



[f50] 

fit* fStSxs (mi , m2 , k) <Dm&ftX*te % (JI^L 

50 s I T-fc^<ko<S^Sr5i:TSo Bf«^««^^»WrSai 
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So **WlS»t*r, * (2 0) <0«fc5fc»5«9tt«T|rr- 
[*5 1 ] 

^ffifl:H-»t5ci^t'#, Zblcg: (2 0) fcdstf 

T'y^^liiotS^nfc. ^{Sc (unity van' 
ance) *J±t>*5 x 5B^fjt?- h Sr^-fa iff t^s L /0 

[0 0 64] 2 ) -jRWailft * 



20 



t-M^^tLT^So Hi 2(4, it (1 1) tC^$tVfcW- 
3**01?* Lit fcwe*!). S (11) 

[0 0 6 5] 
[«5 2] 



A^*;*,, ;*.!,)« /A 1 ( J f-Ar 1 { J r fr .T Tfr ))WMU r .t,/ r r , dt (21) 
>-r„ 1 



mm-z, m^m<om\^. t -t. 8 4*?>t8 6ST- 
s 

[iSc5 3] 

Sr^UTV^o ^L-T, hz (. ) OfjtH, t^t'7> 
[f 5 4] 

±co r K^-yuj ^Wt^So * (2 1) wf+ISteiiLi^ 

^> rttiiit (2D (D&mmh\ tfmftwmn&mm 

HI 1 2fr*5V>T, 
1*5 5] 

A,(«-l(x, r .r.,,)) 



20 



50 



6±(cfig$ix/c (superimposed) M&i 
[*5 6] 

8 4<om%klZ£5T<? V»r«koT^$tb-C^-5. 
it (2 1) tcj; t) , r.coiafHliWTcoSoSr^-rSo 

(1) t3t*7VlW(ttt-£t;'S)5, (2) 

[«5 7] 

**(-*r r .T-T«,.»,) 

Hftli, r ^Ybi-stfrtcro^Sji-s) , ( 3 ) 2 

it (2 1) li&^J: 5 fcix-B. 
[0 0 6 6] 
[$[5 8] 



3K 



|/(Af(M(x./-r fl ,v).,./ r ))p 1 /^(^^-^(^.f-Ji.v))* (22) 



<('.f)= I f I *+yW- 1 (wUr-r < , + r.fJ.r-r a .r r ) 



(23) 



[0 0 6 7] r<E>j£{Ja£/Bl>>T, ^P B ^tr*Sj— T\ B#P B ^ 
.Sx^ifc^T. (STlffi, mi 0fc.^$^TV^-5*g^MIS 

[«C5 9] 



40 ttfctlEftU^. L^L, T/^-^-v^WStLfc^ 

$ fair, z.<D&m-i, -fem&x'&z km 

C#iS5r#U t= fc'TXih 1 (. ) coSFtgtSlti^sK 

[0 0 6 8] C. gggjtgffi&glf^ 
^SffWPS F 
50 1*6 0 1 
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"■r 

st, &w«««ft«^v7'y>'^*-7-*stti&sji„ poc 

4iZn5> 0 POCSTIi, l$Ll«l»*li. iS#M& 

* h i Bflf xN2ff (P=NlxN2) Wgi 

tfSS^ tit V>5 „ POCSMli^ Z-CD^? b 

(closed convex constraint sets ) c^^^jg-f-.*,, 
rtibrojt^rof^i^frt) (intersection) 

{&z)5 - jx h <oM-&<d ^rtu^ti iz-gti HTV > -5 *^e> t? & 



22 



[0 0 6 9] »ffiiJ#*J»ft-&^B8St LT. JJt*f^ffl*iS* 

fd $ Jtfc*tjBff ffl*T = ( 1 — A ) I+1P;0<K 
2 ( Itttl^ffl^^-t") *s^«5*^-c. 
(intersection set) tc:fc^Tt(i££r*i63cD(c/fH ^ 

[00 70] &mi&mwi&(on£.izteftz>mM£t:-hiz. 
10 m&irzjjm&mm-rztzttoiz, pocs©m&i* 

?ijg (mi , mz , k) (D&mmiCttL. SXTlZijk-rffl 

[0 0 7 1 ] 
I»6 1 ] 



me 21 



(25) 



(data consistency constraint sets) t$f-& 0 15. 
[»6 3] 

<^>K*i-*-«ittW-6<jfS«SS:S»:-*--B3fe»*W (priori 
bound) "Cfo-So r <f) (mi , , k) =v 
(mi , mz , k) ( f l-*n®k<D&W{&BLWfe&7ik1-) 30 

X&Z>(OX\ r<" (mi , m 2 , k) <0SEftt±, v 
(mi , mz , k) CO#tit<fc(Wl— -Cfc-5 0 r CD 

a. m*.t£. ; << xtK mmmst 
tri-o-c&^tLTi^-s mz.t£* 9 9 %coft mm^M 

Ltc =3-C4>5) o 

[00 7 2] 5o 40 

fc, LTCO^iBf«r«, /^XdS/J>$ <**>#.]; 

fWl:45„ »jW«tt««?H«fcJ:»), 6 0 to. 0 
1 L<K£LfciB*, POC S .«>ft9&tt 
I-. -r-^fcSewpftt^iR^T'^fco 



[00 7 3] ft*., 

[ififce 4] 

C, r (»ii.mj.t) 

« . {&M®L&mfa<oV-^-7/i>tf^ifoX'i) -5 ^K^fitttir 
*tLTcD^5E#iT-#5o ^tiU, V^/«C-5ffiiccoig; 

#5o 
[$6 5] 

tt* (occlusions) ^«ton^^®«co^v^6*¥^ 

[0 0 7 4] ffiS^Cx (ni , n 2 . tr ) <D 

me e] 

^(OMBz (ni , nz , tr ) 

me 7] 

[0 0 7 5] 
[#6 8] 
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24 
126) 



*(nj,*2^r)+— w — — — JZL-L ,r lz '(m,,m 2 »*)> 6 0 

*(«1,"2''2X -fi^r%,w 2l J|;)<6 ( 
«2.',H ^ L , r — ,r< x >0« lf ra 2 ,*) < -5,, 



^J^^a^— (bounded energy) „ ffltUtt (positivi *#*^^ ^b*i5 0 
ty) , &0 t HK£l^3K— hftif^JEftSWJilftftSrJHlr^-C, [0 0 7 6] 

ftStafctSWifc^-e**. lk^J:9«S«fMKj*yo [f6 9] 

C '/l as ty(' J l."2- f r)-a^/(rJ 1 .n2,f r )^P}. (27) 

r. Zl t\ a*S*#li % a = 0 , b = 2 5 5tfo§ 0 |gfB ^ [0 0 7 7] 

»J«j**-&Ca -^Pa tt*oj:5tej&||aKtiSo * [#7 0] 

0£ jrC/fj n 2t t r )*2$5 

*(«|,*2./ r )>255 



I 255, 



(28) 



[#7 1] 



[#7 2] 



★tt, -T^TcDte^ffeaWftg (mi , rri2 , k) ^bS 

[0 0 7 8] 
[#7 3] 



(29) 



[#74] 

T 

U 

[#7 5] 

[$C7 6J 

[*7 7] 
[»78l 

wmw±mmizfc^x. s^ts. *>si^5)-iaij^*2g (di 

fference metric ) (i-ft*^, / zi'.A L 2 £rffll, 



[«7 9] 

[0 0 7 9] mi 3W:±E«>*ftSrBHwJ;-3T^WUfc 
It8 0] 

//(.) 

£\ {6*¥&,gilH&4 6, 4 8. 5 30lo|cfcH5#g 
H3t3&*g (mi , m 2 . k) 9 0 (rHiS-fttt -5„ 
"t, glM^ (residual term ) 
[f8 1] 

ma 2] 

L It o T , ffcgff <fttt£ft»t?*- -^m^- 

[$C8 3] 

50 
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[#8 4] 
[*8 5] 

WiDftiftig (additive term ) kXcmtilfr (back proje 
ct) U &£- 
[#8 6) 

!aI6ort©, Hffiffig (mi , m 2 , k) £r3§£$-t±- 

±9. 5£ (2 9) K:**nfc*l«Jrt5 
[f8 7] 

f [/,(«,. n 2 ./,)] 

[#8 8] 

[0 0 8 0] gT!:> POCS Kg<5t, *1tm±Jjfe<D& 

[0081] i . swift. Rvmrnttm t , 

So 

[0 0 8 2] 2. ^Mfe^-Jr^L, ^co««?iftiS 

El2&t/lll6ic:*$ix-CV>5«3jT-{4, r = 2-C&-5) 
3. JltMiJt&fT? : #{g*?{£Spf{£ g (mi , m 2 , 

[0 0 8 3] 4. 3M'<X#**&tt«Mttta (mi , 
m 2 , k) irttL. it (2 4) tfoTl^- 
[#8 9] ... 



2(5 



[0 0 8 4] 5 . 
[#9 0] 



/0 



20 



^S***tfc#ffia (mi , m2 , k) IT, 
«3f P S F 
[«9 1] 

[0 0 8 5] 6 . ?mmi&!£ffi&(D-y->yj >-?fe^±iz 
[#9 2] 

jjj(«l.'»2.''r) 

[00 8 6] 7 . jfc-g- 
[#9 3] 

#^j|£;h,Tl> 5 "T^T (mi , m2 , k) \z*t 

U it (2 5) KfEoTJ*^ 
[#9 4] 

Srilfcti-rs ; it (2 6) <7?*fl£ 
[#9 5] 



50 



[«9 6] 



£ri8?JNJ2 (back-project) i-£ c 
[0 0 8 7] 8. ft (2 8) «r/H^Ti««*rt&PA fcfi 1 

[0088] 9. &itmmt>mrc£titi&^ «ut-r5 0 
[oo89] f»jtafiai*«*fc*nnii, 

[0 0 9 0] »ar4lHlfc»IBtBBU, *3MU«rBMBL 
[00 9 1 ] 

so zitoi: otem\&*%m-tz>z.h&x%z> 0 ^?&m 
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(15) 

27 

\±s am&^<Dftm (pocs) izm<5<jjt£&m\<* 

So £61-, #3891 J* , iS«tff5& (motion estimates) 

[Hi l *p^±s/^Ti/^^t7'p y^H-e 
[02] mmmv-^yv »u**wcj: 

[B3] *»Wfc5M-r5iiaft«llSr*Lfc«EI»EH 

So 

[El 5 ] *J5WK J; S s/ ^**fc£riti-5ifte 
[06] J: S ^ * fcTv ^SeftfcftfiR-r 5 20 

[0 7] **wfcj:aia*^fo*ixfcp sFetit 

[0 8 ] *IRIBffi(rfc»t5(^««W{ft(Offi»Jl»^ 
«t S tf P S F o#a**»Sr*i-Ht?*> So 

[0 9] ^aiia^s^co p s f ^^fc^^m-efo 

So 

[010] LSI ffttH* 

[«9 7] 5 ^ 



#ifl¥8- 2 6 3 6 3 9 

[011] 
[f9 8] 

[012] ^^tifcWa^Ct P S F Sr^tti-TS^ 
{c, r ^ ^^^MiSi"Siai£Sit)^e-rVu (perspect 
ive motion model) ^ffli^^Si5ffilSr^i-fc*(0|2IT 

foSo 

[(Hi 3] POCSfr»<3<Hf*S**ffiSrtfiP^i-S 
[»to«S] 

1 o i&Mfcgmfe ,12 y b° > pm&ms* "r y 
7s 14 MPSFS^f^^ i6 mm&sm 

to&l&XTiy'?* 18 K«»SH{£^;*^:7\ 2 
0 tr«A3-y/vCR, 2 2 f'-f 5^>f 

2 4 Hf/lsX^/lsJJ * 9, 2 6 T^S^/HTy* 
t^An-^ 2 8 ^/l^^r-y^ 3 0 
^^fiSK^fi, 3 2 PHt^S^>-fc^~>^^ 3 4 

a^fcTa.— £\ 3 6 CRT, 3 8 h\ 4 

0 ^lly^ 4 2 |B«fflE#\ 4 4 ii«*yM7- 
^ 4 6, 4 8, 5 0 {SAttfcKBffe* 5 2 ftfeffi 

«> 5 3 5 4 ^Vr^yKIfyy 

y^tt*, 5 6 jeui^^^y eo ^ 

^If^ft^f/K 6 2 T/<— ^NMB^t'/K 6 4 

ismmmy-^y}) ^^vk 6 6 f«y^xw 
/k 6 8 -t^-y-Tv*- 6 9 nmtoA-y-^y 

^#W&. 7 0 Wffu 7 1 irv^r^— ^-rJr:J:o 
t-*Snt««, 7 3 1r>^T^— ^<^4>4X 7 
6 7 (H) , 80 tfk^ 8 2 Wft 

cd^ix s 4 .aejftsnfc«jt«, 8 6 7 sm-&iitz.\z 
nm. s 8 ftmfeftiaife, 9 0 mmammim. 



[01 1 



[02] 
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16 
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[1213] 
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[B96] 
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(17) 



2 6 3 6 3 9 



[08] 



[mi o] 




70 




at r=T a 



[012] 



[013] 




M(x.r-t-T at t r ) 
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